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(54) OPTIMAL FITTING PARAMETER DETERMINING METHOD AND DEVICE&comma; AND 
OPTIMAL FITTING PARAMETER DETERMINING PROGRAM 



(57) The fitting parameters of a physics model are 
represented in the form of real-number vectors as the 
information on chromosomes of a genetic algorithm, a 
plurality of individuals having the chromosomes is pre- 
pared and a genetic algorithm is used to fit and optimize 
the parameters to the measured data points of physical 
quantities. Child individuals from the crossover process 
of the genetic algorithm are generated from three parent 
individuals at a determined normal distribution probabil- 
ity, and the replacement process takes individuals that 
are superior with respect to all criteria from among the 
selected parent individuals and plurality of child individ- 
uals and makes them the individuals of the next gener- 
ation population. Moreover, optimal fitting parameters 
are found for each set of measurement data points un- 
der a plurality of experimental conditions, and collective 
fitting is performed so that the fitting parameters vary 
smoothly even among experimental conditions: There- 
by, it is possible to simulate physical phenomena with 
physics models without error even under experimental 
conditions at which experiments were not performed. 
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Description 

Field of the Invention: 

[0001] The invention relates to a method and apparatus for determining optimal fitting parameters and to an optimal 
fitting parameter determination program, whereby a physics model having a plurality of parameters is fitted as close 
as possible to discrete data obtained by means of the measurement of physical qualities. 

Background Art: 



[0002] The analysis of physical phenomena from experimental results and the prediction of these phenomena using 
the results of this analysis are often performed in engineering. In this case, the procedure performed is as follows: a 
physics model is proposed to explain the experimental results, and the physics model is determined and fit so that the 
parameters of that physics model match the experimental results (x,, y } ) as closely as possible (see FIG. 1). Once the 
15 fitting parameters are determined, that physics model can be used to predict the physical phenomenon without per- 
forming experiments. 

[0003] However, in order to predict physical phenomena with the highest possible precision, it is necessary to fit the 
parameters of the physics model as precisely as possible. In order to do this, fitting using the least squares method 
had been performed in the past. For example, in JP-A HEI 7-73207, a method is proposed wherein the parameters of 
20 a predetermined interatomic potential function are determined by the least squares method to match the experimental 
results. 

[0004] However, in recent years there is a need to predict physical phenomena with even better precision, so the 
proposed physics models have become more complex and more sophisticated. For this reason, the number of param- 
eters to be fitted increases and if the conventional least squares method is used, the calculations often require large 
25 amounts of time. 

[0005] In addition, when fitting the parameters of complex physics models, the setting of the initial parameters in 
calculation becomes important. If the setting of these initial parameters is done poorly, convergence may require a 
long time or a completely incorrect solution may be obtained in certain cases. This is because the parameter values 
may fall into a local minimum in the parameter space in the middle of an iterative calculation. As a result, in order to 
30 obtain the optimal initial values, one must ultimately depend on trial and error, so there is a problem in that a large 
amount of time and effort is required. 

[0006] Moreover, when the least squares method is used, the sum of the squares of the difference between the 
experimental data and the predicted data calculated from the physics model is used as the evaluation criterion. How- 
ever, evaluating the sum of squares alone is inadequate, so it is also necessary to evaluate the maximum absolute 
35 value of the error. Yet the conventional least squares method cannot handle anything except the sum of the squares 
of the error. 

[0007] On the other hand, the genetic algorithm is one probabilistic search technique that: (1) works effectively in 
large-scale searches, (2) does not require differentials or other derivative information other than the evaluation function, 
and (3) is an algorithm that is easily implemented. This algorithm can be applied to the optimization of the fitting pa- 
*o rameters, and has the promise of solving the aforementioned problems. However, with the prior art, the genetic oper- 
ation used within the genetic algorithm can handle only discrete parameter values (binary values), so it is necessary 
to discretize the physics model parameters which are conventionally continuous values, and thus it has been difficult 
to obtain solutions with sufficient precision within a practical period of time. 

[0008] To wit, if one attempts to obtain a sufficiently precise solution with the conventional discrete genetic algorithm, 
45 the degree of discretization of the various parameters must be made extremely fine, so the amount of genetic infor- 
mation is necessarily large, thus leading to a marked increase in computation time. Conversely, if the various param- 
eters are discretized roughly in order to obtain a solution within a practical amount of computation time, there is a risk 
that the optimal solution may not be reached if the optimal solution is present between the smallest increments in 
discretization. 

50 [0009] Moreover, the conventional genetic algorithm has the problem of premature convergence. This is a problem 
wherein, when a solution with relatively good precision is found in the initial stage of a search, individuals that resemble 
that solution make up most of the population , and the search does not proceed any further. Problems of fitting parameter 
optimization have the possibility of having many local minimums so there is the problem in that such premature con- 
vergence may occur frequently so a sufficiently precise solution is not obtained. 

[0010] This problem of premature convergence is typically avoided in the prior art by increasing the number of indi- 
viduals in the population, but this gives rise to the problem in that the amount of computation increases and convergence 
to the optimal solution becomes slower. 

[0011] The present invention was proposed in light of such problems that are unresolved in the prior art, and has as 
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its object to provide a method and apparatus for determining optimal fitting parameters, and an optimal fitting parameter 
determination program that is able to efficiently fit the parameters of a physics model precisely and optimally. 

Disclosure of the Invention: 

5 

[0012] This invention provides a method of determining optimal fitting parameters, which comprises: in a physics 
model having a plurality of parameters, in order to determine optimal fitting parameters for discrete data points obtained 
by measurement of physical quantities, representing the plurality of parameters in a form of real-number vectors as 
information on chromosomes of a genetic algorithm, preparing a population of a plurality of individuals having the 

10 chromosomes and using the genetic algorithm to optimize fitting parameters. 

[00.13] Moreover, in the method of determining optimal fitting parameters according to this invention, the genetic 
algorithm comprises at least: a selection step of selecting at least two parent individuals, a child individual generation 
step of generating a plurality of new child individuals by applying at least one of a group of genetic operations consisting 
of a crossover process and a mutation process to the selected parent individuals, and a replacement step of determining 

15 individuals to be made individuals of a next generation of population from among the selected parent individuals and 
the generated new child individuals. 

[0014] In the method of determining optimal fitting parameters according to this invention, in the child individual 
generation step, the crossover process generates child individuals with real-number vectors having as components 
values appearing according to a continuous stipulated incidence probability distribution, and the incidence probability 

20 distribution is set based on real-number vector components of each of the selected parent individuals. 

[0015] In the method of determining optimal fitting parameters according to this invention , in the child individual 
generation step, the mutation process generates child individuals with real-number vectors having as components 
values appearing according to a continuous stipulated incidence probability distribution, and the incidence probability 
distribution is such that an incidence probability becomes higher the closer to at least one of the selected parent 

25 individuals. 

[001 6] In the method of determining optimal fitting parameters according to this invention, in the selection step, three 
parent individuals are selected and the incidence probability distribution is a normal distribution centered on center 
points of two of the three selected parent individuals, and a standard deviation of the normal distribution is such that 
a component in a direction of a main axis connecting real-number vectors of the two parent individuals is proportional 
30 to a distance between the two parent individuals, and components in other axes are proportional to a distance between 
the main axis and a remaining one of the three selected parent individuals. 

[0017] In addition, in the method of determining optimal fitting parameters according to this invention, the population 
of the plurality of individuals is laid out on lattice vertices, and in the selection step, regional subpoputations are formed 
from each individual and a stipulated number of neighboring individuals, and the at least two parent individuals are 

35 selected from among the regional subpopulations. 

[0018] In the method of determining optimal fitting parameters according to this invention, in the replacement step, 
from among the selected parent individuals and the generated new child individuals, individuals of the next generation 
of population are determined based on a superiority relationship consisting of one evaluation criterion. 
[0019] In the method of determining optimal fitting parameters according to this invention, in the replacement step, 

40 from among the selected parent individuals and the generated new child individuals, individuals of the next generation 
of population are determined based on a superiority relationship consisting of two or more evaluation criteria. 
[0020] In the method of determining optimal fitting parameters according to this invention, optimization by means of 
a local search technique is performed with respect to the fitting parameters optimized using the genetic algorithm. 
[0021] In the method of determining optimal fitting parameters according to this invention, the physics model is pro- 

45 vided for each of different experimental conditions, a plurality of sets of measurement data are provided by varying 
each of the experimental conditions in a stepwise manner, optimal fitting parameters for the physics model are found 
for each set of measurement data by means of an optimization technique, the fitting parameters are fitted using fitting 
functions so that changes among the experimental conditions are smooth, and the optimal fitting parameters of the 
physics model for each experimental condition are determined collectively. 

so [0022] In the method of determining optimal fitting parameters according to this invention, the optimization technique 
is performed by means of a local search technique. 

[0023] The invention also provides an optimal fitting parameter determination apparatus for a physics model having 
a plurality of parameters, comprising: fitness calculation means that, for discrete data points obtained by measurement 
of physical quantities, calculates a fitness based on measurement data and predicted values calculated from the physics 
55 model, genetic operation means wherein the plurality of parameters are represented in a form of real-number vectors 
as information on chromosomes, of a genetic algorithm and genetic operations of the genetic algorithm are performed 
on a population of a plurality of individuals having the chromosomes : and judgment means that judges whether or not 
a next generation of the individual population meets an evaluation criterion, wherein an individual that has a highest 
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fitness within the individual population when the next generation of the individual population meets the evaluation 
criterion is used for the optimal fitting parameters of the physical model. 

[0024] In the optimal fitting parameter determination apparatus according to this invention, the genetic operation 
means comprises at least: a selection processor that selects at least two parent individuals, a child individual generator 
that generates a plurality of new child individuals by applying at least one of a group of genetic operations consisting 
of a crossover process and a mutation process to the selected parent individuals, and a replacement processor that 
determines individuals to be made individuals of the next generation of the individual population from among the se- 
lected parent individuals and the generated new child individuals. 

[0025] In the optimal fitting parameter determination apparatus according to this invention, in the child individual 
generator, the crossover process generates child individuals with real-number vectors having as components values 
appearing according to a continuous stipulated incidence probability distribution, and the incidence probability distri- 
bution is set based on real-number vector components of each of the selected parent individuals. 
[0026] In the optimal fitting parameter determination apparatus according to this invention, in the child individual 
generator, the mutation process generates child individuals with real-number vectors having as components values 
appearing according to a continuous stipulated incidence probability distribution, and the incidence probability distri- 
bution is such that an incidence probability becomes higher the closer to at least one of the selected parent individuals. 
[0027] In the optimal fitting parameter determination apparatus according to this invention, in the selection processor, 
three parent individuals are selected and the incidence probability distribution is a normal distribution centered on 
center points of two of the three selected parent individuals, and a standard deviation of the normal distribution is such 
that a component in a direction of a main axis connecting real-number vectors of the two parent individuals is propor- 
tional to a distance between the two parent individuals, and components in other axes are proportional to a distance 
between the main axis and a remaining one of the three selected parent individuals. 

[0028] In the optimal fitting parameter determination apparatus according to this invention, the population of the 
plurality of individuals is laid out on lattice vertices, and in the selection processor, regional subpopulations are formed 
from each individual and a stipulated number of neighboring individuals, and at least two parent individuals are selected 
from among the regional subpopulations. 

[0029] In the optimal fitting parameter determination apparatus according to this invention, in the replacement proc- 
essor, from among the selected parent individual and the generated new child individuals, individuals of the next gen- 
eration of population are determined based on a superiority relationship consisting of one evaluation criterion. 
[0030] In the optimal fitting parameter determination apparatus according to this invention, in the replacement proc- 
essor, from among the selected parent individual and the generated new child individuals, individuals of the next gen- 
eration of the population are determined based on a superiority relationship consisting of two or more evaluation criteria. 
[0031] The optimal fitting parameter determination apparatus according to this invention further comprises process- 
ing means that performs optimization by means of a local search technique with respect to the fitting parameters 
optimized using the genetic algorithm. 

[0032] The optimal fitting parameter determination apparatus according to this invention further comprises optimi- 
zation means that, when a plurality of sets of measurement data are provided by varying each of experimental conditions 
in a stepwise manner, finds optimal fitting parameters for each set of measurement data by means of an optimization 
technique, and parameter fitting processing means that fits the fitting parameters using fitting functions so that changes 
among the experimental conditions are smooth, wherein the fitness calculation means calculates the fitness based on 
the fitting parameters found by the parameter fitting processing means. 

[0033] In the optimal fitting parameter determination apparatus according to this invention, the optimization means 
performs optimization by means of a local search technique. 

[0034] The invention also provides an optimal fitting parameter determination program executed by a computer, 
implementing a process wherein: parameters of a physics model having a plurality of parameters are represented in 
a form of real-number vectors as information on chromosomes of a genetic algorithm, and a population of a plurality 
of individuals having the chromosomes is prepared and the genetic algorithm is used to optimize fitting parameters. 
[0035] In the optimal fitting parameter determination program according to this invention, the genetic algorithm com- 
prises at least: a selection step of selecting at least two parent individuals, a child individual generation step of gener- 
ating a plurality of new child individuals by applying at least one of a group of genetic operations consisting of a crossover 
process and a mutation process to the selected parent individuals, a fitness calculation step of calculating the physics 
model and calculating fitness values of the generated new child individuals, and a replacement step of determining 
individuals to be made individuals of a next generation of population from among the selected parent individuals and 
the generated new child individuals based on the calculated fitness values. 

[0036] In the optimal fitting parameter determination program according to this invention, in the child individual gen- 
eration step, the crossover process generates child individuals with real-number vectors having as components values 
appearing according to a continuous stipulated incidence probability distribution, and the incidence probability distri- 
bution is set based on real-number vector components of each of the selected parent individuals. 
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[0037] In the optimal fitting parameter determination program according to this invention, in the child individual gen- 
eration step, the mutation process generates child individuals with real-number vectors having as components values 
appearing according.to a continuous stipulated incidence probability distribution, and the incidence probability distri- 
bution is such that an incidence probability becomes higher the closer to at least one of the selected parent individuals. 

s [0038] In the optimal fitting parameter determination program according to this invention, in the selection step, three 
parenl individuals are selected and the incidence probability distribution is a normal distribution centered on center 
points of two of the three selected parent individuals, and a standard deviation of the normal distribution is such that 
a component in a direction of a main axis connecting real-number vectors of the two parent individuals is proportional 
to a distance between the two parent individuals, and components in other axes are proportional to a distance between 

10 the main axis and a remaining one of the three selected parent individuals. 

[0039] In the optimal fitting parameter determination program according to this invention, the population of the plurality 
of individuals is laid out on lattice vertices, and in the selection step, regional subpopulations are formed from each 
individual and a stipulated number of neighboring individuals, and at least two parent individuals are selected from 
among the regional subpopulations. 

15 [0040] In the optimal fitting parameter determination program according to this invention, in the replacement step, 
from among the selected parent individual and the generated new child individuals, individuals of the next generation 
of population are determined based on a superiority relationship consisting of one evaluation criterion. 
[0041] In the optimal fitting parameter determination program according to this invention, in the replacement step, 
from among the selected parent individual and the generated new child individuals, individuals of the next generation 

20 of population are determined based on a superiority relationship consisting of two or more evaluation criteria. 

[0042] In the optimal fitting parameter determination program according to this invention, optimization by means of 
a local search technique is performed with respect to the fitting parameters optimized using the genetic algorithm. 
[0043] In the optimal fitting parameter determination program according to this invention, optimal fitting parameters 
for the physics model are found for each set of measurement data by means of an optimization technique, the fitting 

25 parameters are fitted using fitting functions so that changes among experimental conditions are smooth, and the optimal 
fitting parameters of the physics model for each experimental condition are determined collectively. 
[0044] In the optimal fitting parameter determination program according to this invention, the optimization technique 
is performed by means of a local search technique. 

[0045] As described above, with this invention, the fitting parameters of a physics model are expressed as real- 
30 number vectors, and it is possible to optimize fitting parameters using a genetic algorithm by preparing a population 
of a plurality of individuals that have the aforementioned chromosomes, so the process of discretizing chromosome 
information is unnecessary, and the precision of the solutions obtained and computation time are not affected by the 
precision of discretization. 

35 Brief Explanation of the Drawings: 

[0046] FJG. 1 is an explanatory diagram used to describe the fitting of measurement data with a physics model. 
[0047] FIG. 2 is a schematic flowchart of the procedure of fitting parameter optimization according to the present 
invention. 

40 [0048] FIG. 3 is a schematic flowchart of the procedure of a typical genetic algorithm. 

[0049] FIG. 4 is an explanatory diagram illustrating an example of a chromosome used in a typical genetic algorithm. 
[0050] FIG. 5 is an explanatory diagram illustrating the chromosomes used in the genetic algorithm in the method 
of the present invention and the fitting parameters optimized thereby. 

[0051] FIG. 6 is an explanatory diagram illustrating the fitness used in the genetic algorithm of Embodiment 1 . 
45 [0052] FIG. 7 is a flowchart of the procedure of the crossover process performed in the genetic algorithm according 
to the method of the present invention. 

[0053] FIG. 8 is a diagram illustrating an example of the crossover process performed in the genetic algorithm ac- 
cording to the method of the present invention. 

[0054] FIG. 9 is an explanatory diagram illustrating the procedure of the mutation process performed in the genetic 
so algorithm according to the method of the present invention. 

[0055] FIG. 10 is a flowchart of the procedure of the replacement process performed in the genetic algorithm ac- 
cording to the method of the present invention. 

[0056] FIG. 11 is a flowchart of the procedure of the fitting parameter optimization used in the genetic algorithm of 
Embodiment 1 . 

55 [0057] FIG. 1 2 is a diagram used to describe an example of regional subpopulations in a modification of Embodiment 
1. 

[0058] FIG. 13 is a flowchart of the procedure of the selection step in the modification of Embodiment 1 . 

[0059] FIG. 14 is a flowchart of the procedure of the fitting parameter optimization used in the genetic algorithm of 
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Embodiment 2. 

[0060] FIG. 15 is a flowchart of the procedure of the replacement step of Embodiment 2. 

[0061 ] FIG. 1 6 is a diagram illustrating the fitting curve (Experimental Condition 1 ) calculated by the fitting parameter 
optimization according to Embodiment 1. 
5 [0062] FIG. 1 7 is a diagram illustrating the fitting curve (Experimental Condition 1 0) calculated by the fining parameter 
optimization according to Embodiment 1 . 

[0063] FIG. 1 8 is a graph of the change in the fitting parameter R p calculated under each of the experimental con- 
ditions. 

[0064] FIG. 1 9 is a graph of the change in the fitting parameter <j p calculated under each of the experimental condi- 
10 tions. 

[0065] FIG. 20 is a graph of the change in the fitting parameter y calculated under each of the experimental conditions. 
[0066] FIG. 21 is a graph of the change in the fitting parameter (3 calculated under each of the experimental conditions. 
[0067] FIG. 22 is a flowchart of the procedure of the fitting parameter optimization used in the genetic algorithm of 
Embodiment 3. 

15 [0068] FIG. 23 is a diagram showing the correspondence of chromosomes, genes and experimental conditions, and 
fitting parameters in Embodiment 3. 

[0069] FIG. 24 is a flowchart showing the procedure for calculating the fitness in consideration of smoothness ac- 
cording to Embodiment 3. 

[0070J FIG. 25 is a flowchart of the procedure for calculating the mean square error under a certain experimental 
20 condition of Embodiment 3. 

[0071] FIG. 26 is a graph of the change in the fitting parameter R p calculated in accordance with Embodiment 3. 

[0072] FIG. 27 is a graph of the change in the fitting parameter o p calculated in accordance with Embodiment 3. 

[0073] FIG. 28 is a graph of the change in the fitting parameter y calculated in accordance with Embodiment 3. 

[0074] FIG. 29 is a graph of the change in the fitting parameter p calculated in accordance with Embodiment 3. 
25 [0075] FIG. 30 is a functional block diagram of the fitting parameter optimization apparatus that works the methods 

of Embodiment 1 and Embodiment 2. 

[0076] FIG. 31 is a functional block diagram of the fitting parameter optimization apparatus that works the methods 
of Embodiment 1 and Embodiment 2, in the case that the procedure of a physics model computation is included. 
[0077] FIG. 32 is a functional block diagram of the fitting parameter optimization apparatus that works the method 
30 of Embodiment 3. 

[0078] FIG. 33 is a functional block diagram of the fitting parameter optimization apparatus that works the method 
of Embodiment 3, in the case that the procedure of a physics model computation is included. 

Best Mode for Carrying out the Invention: 

35 

[0079] Here follows a description of an embodiment of the present invention made with reference to the appended 
drawings: FIG. 2 is a flowchart of the process of determining optimal fitting parameters for the physics model according 
to Embodiment 1 of the present invention. In FIG. 2, first in Step S1, a set of discrete measurements of physical 
quantities is prepared. Next in Step S2, a physics model that fits the measurement data is proposed. In the next Step 
40 S3, a genetic algorithm is used to optimize the parameters of the physics model proposed in Step S2. Lastly in Step 
S4, the parameters of the final physics model are determined. 

[0080] The literature on genetic algorithms includes Genetic Algorithms in Search, Optimization, and Machine Learn- 
ing by David E. Goldberg published in 1989 by the Addison-Wesley Publishing Company, Inc. 

[0081] In a typical genetic algorithm, a population of ideal organisms having genes is established and those individ- 
45 uals that are fittest with respect to a predetermined environment are allowed to survive and the probability of their 
leaving descendents depends on this fitness. Then, the children inherit the genes of the parents through a procedure 
called genetic operation. By performing such a change of generations, the genes and organism population are allowed 
to evolve until individuals having a high fitness account for a large proportion of the organism population. Moreover, 
the types of genetic operation used at this time include the crossover of genes, mutations and the like which also occur 
so in the reproduction of real organisms. 

[0082] FIG. 3 is a schematic flowchart of the procedure of a typical genetic algorithm. In this procedure, in the first 
Step S1 1 , the structure of the chromosomes of an individual is determined. To wit, the format of data to be used during 
the change of generations is decided on from the parent individuals to the descendent individuals. FIG. 4. shows an 
example of the structure of a chromosome. Here, the variable vector x of the optimization problem to be solved is 
55 represented by n symbols A t (where / = 1 , 2, ... n), and these are taken to be a chromosome with n genes. In FIG. 4, 
Ch symbolizes the chromosome and Gs the genes, where the number of genes n is 5. The gene values A,are typically 
binary numbers with a value of 0 or 1. In the example of FIG. 4, the letters a to e are genes. A set of genes thus 
symbolized is the chromosome of an individual. 
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[0083] In Step S11 of FIG. 3, the method of calculating the fitness that indicates how fit each individual is with respect 
to the environment is selected from memory and entered. At this time, an evaluation function for the optimization 
problem to be solved is designed so that the higher variable or lower variable its value is, the higher the fitness of the 
corresponding individual becomes. In addition, in the change of generations performed thereafter, the higher the fitness 

5 of an individual, the greater its probability of survival or its probability of leaving descendents becomes in comparison 
to individuals with a lower fitness. Conversely, individuals with a low fitness are assumed to be individuals ill fit to the 
environment and are allowed to die out. This reflects the principle of natural selection in the theory of evolution. To wit, 
the fitness is a measure that indicates the superiority of each individual when seen from the probability of survival. 
[0084] In a genetic algorithm, the problem to be solved is typically a total black box at the time of the start of the 

10 search, so it is completely unknown as to what kind of individual is desirable. For this reason, the initial organism 
population is generated using random numbers to randomly generate individuals. Accordingly, in the procedure de- 
scribed here also, in Step S13 after the process is started in Step S12, the initial organism population is generated 
randomly using random numbers. Note that if there is any advance knowledge of the search space, the organism 
population may be generated mainly in those portions where the evaluated value is thought to be high. Here, the total 

15 number of individuals generated is the number of individuals in the population. 

[0085] Next in Step S1 4, the fitness of each individual in the organism population is calculated using the calculation 
method determined previously in Step S11 . Once the fitness is determined for each individual, in the next Step S15, 
from the population, the individuals are selected to form the basis of the next generation of individuals. However, if 
only selection is performed, this will simply increase the proportion within the organism population of individuals having 

20 the highest fitness at the current point in time, and no new search point is generated. For this reason, the manipulations 
called crossover and mutation to be described below are performed. 

[0086] To wit, in the next Step S16, from the next generation of individuals generated by selection, pairs of two 
individuals are randomly selected at a stipulated frequency and their chromosomes are combined to create a child 
chromosome (crossover). Here, the probability of a cross occurring is called the crossover rate. The descendent indi- 
25 viduals generated from crossover are individuals that inherit traits of each of the individuals that were its parents. This 
crossover causes evolution that increases the diversity of chromosomes of individuals. 

[0087] After crossover, in the next Step S1 7, the genes of individuals suddenly change at a fixed probability (muta- 
tion). Here, the probability of a mutation occurring is called the mutation rate. The phenomenon of genes being over- 
written with a low probability is one that is seen also in the genes of real organisms. However, if the mutation rate is 
30 set too high, the characteristics of traits inherited from parents in crossover are lost, so this is equivalent to a random 
search of the search space and thus care is needed. 

[0088] Once the next-generation population is determined by means of this process, next in Step S1 8, it is determined 
whether or not the next-generation organism population thus generated satisfies the evaluation criteria for ending the 
search. These evaluation criteria depend on the problem, but typical criteria include the following. 

35 

The maximum fitness within the organism population is greater than a threshold value. 
The average fitness within the organism population is greater than a threshold value. 

Generations with a rate of increase of the fitness within the organism population less than a certain threshold value 
have continued for longer than a fixed period of time. 
40 . The number of changes of generations has reached a predetermined number. 

[0089] If one of the end conditions described above is met, the search goes to Step S19 to end the search. The 
individual with the highest fitness within the organism population at that time becomes the solution to the optimization 
problem being sought. If the ending condition is not met, the search is returned to the step of calculating the fitness of 
45 each individual in Step S1 4 to continue the search. By repeating this change of generations in this manner, it is possible 
to increase the fitness of individuals while maintaining a constant number of individuals in the population. This completes 
an overview of a typical genetic algorithm. 

[0090] The framework of the genetic algorithm described above is a loose one that does not stipulate the details of 
actual programming, and thus it does not stipulate a detailed algorithm for individual problems. For this reason, the 
50 genetic algorithm used at the time of determining the optimization fitting parameters according to the present invention 
must implement the following items for determining optimization-fitting parameters: 

(a) the method of representing chromosomes 

(b) the individual evaluation function 
55 (c) the selection method 

(d) the crossover method 

(e) the mutation method 

(f) the search end conditions 
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[0091] (a) Method of representing chromosomes: this Embodiment is characterized in that the chromosome repre- 
sentation in the genetic algorithm is such that the parameters of the physics model are. used directly as real-number 
vectors, and thus there is no need for the process of discretization of chromosome information and this solves the 
problem in which the precision of discretization affects the precision of the solution found and the computation time. 

5 [0092] Here follows a description of this with reference to the example of an individual gene shown in FIG. 5. The 
structure of chromosomes in the genetic algorithm is such that there is a one-to-one correspondence between the 
genes and the physics model's parameter values (a, (3, y. 8. <W (number of parameters n = 5). When the physics model's 
parameter values are (+2.31, -6.45, -3.28, +3.55, -4.12), the genetic algorithm's chromosome, becomes (+2.31 , -6.45, 
-3.28, +3.55, -4.12). In the example of FIG. 5, the number of parameters n is 5 and this number is different depending 

10 on the physics model proposed. 

[0093] (b) Individual evaluation function: the individual evaluation function of the genetic algorithm, namely the fitness 
used, is the mean square of the error between the discretized measurement data from the experimental results and 
the theoretical values calculated from the physics model determined by the parameters encoded in the chromosome. 
In addition, the fitness evaluation may be performed not only by the aforementioned mean square error but also by 

15 the maximum of the absolute value of the error. In the example of FIG. 6, the physics model is y = f(x) where x is a 
variable, and when the five fitting parameters (a, p, y, 6, <t>) are found from six sets of experimental data (x 1 , y t ) through 
(*6> /6)' an example is shown where the two functions Ex. 1 and Ex. 2 can be used as evaluation functions suited to 
the physics model environment. 

[0094] The evaluation function thus determined may possibly have a large number of locally optimum solutions (local 

20 minima). For this reason, when typical search techniques, such as the hillclimbing method or simplex method, are 
used, the search may be caught in local minima and as a result, high-precision fitting parameters may not be obtained. 
However, the genetic algorithm is a probabilistic technique and is also a parallel search technique using a plurality of 
search points, with characteristics that make it not easily caught in local minima, so by using the evaluation functions 
according to this Embodiment, the search can proceed extremely effectively. 

25 [0095] (d) Crossover method: in the conventional genetic algorithm that handles discrete binary values, crossover 
is performed by partially exchanging the genes in the chromosome. However, in the gene-type space defined by a 
binary representation, the phase structure is much different from the actual fitting parameter space after conversion 
to real-number values. For example, even if only one bit is inverted in a binary number, its effect in the parameters 
after conversion will differ depending on the position of the inverted bit. If the most significant bit is inverted, this will 

30 greatly change its parameter value but if the least significant bit is inverted the parameter will hardly change at all. 
[0096] Thus, in the conventional crossover method in which the genes are partially exchanged, the child individuals 
do not appropriately inherit the traits acquired by the parent individuals because continuity of the parameter space is 
not taken into consideration. For this reason, there are problems in which meaningless searches are repeated or 
searching is not performed adequately, so optimization is not performed adequately. To this end, the present invention 

35 proposes a novel crossover method that takes into consideration the continuity of fitting parameters. 

[0097] FIG. 7 is a schematic flowchart of one example of the crossover used in the present invention. First, in Step 
S21 , parent individual 3 is randomly selected from the individual population. Next in Step S22, is calculated the center 
C between the parameters of parent individual 1 and parent individual 2 selected by means of the selection of Step 
S1 5 of FIG. 3. Then in Step S23, the two child individuals are generated according to a continuous stipulated incidence 

*o distribution set in the periphery of the center C, e.g. a normal distribution probability. Specifically, a child individual is 
generated according to equation (1) below. A Cauchy distribution or other differentiate incidence distribution may be 
used as the continuous incidence distribution. 



45 



50 



x k =x € +& + 'jjififi (1) 



where 



X c= §( x 1 + X 2> 



55 d=x 2 -x, 



[0098] Here, n is the number of parameters (number of dimensions in the parameter space, x k is the coordinate in 
the parameter space of the generated child individual k, x c is the coordinate of the center C, d is the vector of the line 
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(called the main axis) connecting parent individual 1 and parent individual 2, and D is the distance from parent individual 
3 to the main axis. e ; is the normal orthogonal base vector forming a partial space (n-1 dimensions) perpendicular to 
the main axis, c is a random number according to the normal distribution N(0, o^ 2 ), r), is n-1 independent random 
numbers according to the normal distribution N(0 t a n 2 ). If two parent individuals 3 are selected randomly and the child 
5 individual generation according to equation (1 ) is repeated twice, child-individuals x k1 and can be generated from 
parent individuals 1 and 2. 

[0099] FIG. 8 shows the method of finding the standard deviation or the normal distribution probability in the case 
that there are two fitting parameters a and p (two-dimensional parameter space). The component a* of the standard 
deviation of the normal distribution in the direction of the main axis is proportional to the distance Idl between the two 
10 parents (a^ = aid!), and the axis component a n perpendicular thereto is set to be proportional to the distance Dfrom 
the main axis to parent individual 3 (o n = bD). 

[0100] By using this crossover method (child individual generation method), the continuity of the fitting parameters 
can be treated as positive. Treating as positive means that neighboring individuals in the parameter space are also 
neighboring in the gene space. If the binary number representation of the conventional technique is used for the gene 

15 representation, neighboring individuals in the parameter space are not necessarily neighboring in the gene space, so 
the search process is performed as a global search in both the starting and ending stages. However, with the technique 
described above, global searches are performed in the early stages of the search in which the distances among parents 
within the population are long, but in the ending stages of the search in which the distances among parents are short, 
a local search can be performed. 

20 [0101] (e) Mutation method: in the conventional genetic algorithm that handles discrete binary values, mutation is 
performed by an operation in which some of the genes of the chromosome are inverted. However, because this oper- 
ation also does not take into consideration the continuity of fitting parameters, each stage of the search was in charge 
of both global searches and local searches. To solve this problem, in this Embodiment, mutation was made an operation 
in which normal random numbers generated according to the normal distribution A/(0, a 2 ) are added to each gene of 

25 the chromosome of the child individuals. Thereby, mutations are in charge of only local searches and thus searches 
can be performed effectively in the last stages of the search. 

[0102] To describe mutation according to this Embodiment with the sample chromosome of FIG. 9, when chromo- 
some Ch5 has the values 

(+2.31 -6.45 -3.28 +3.55 -4.12) and the random numbers generated independently according to the normal distribution 
30 for each gene are 

(+0.1 2 -0.05 +0.02 -0.07 -0.09) adding these to the chromosome Ch5 gives the chromosome Ch6 which is changed to 
(+2.45 -6.50 -3.26 +3.48 -4.21). 

[0103] If the standard deviation of the normal distribution is made too large, the search becomes the same as a 
random search, so preliminary experiments are used to determine appropriate values. Note that the random numbers 

35 to be added may be based on a Cauchy distribution or other distribution in addition to a normal distribution. 

[0104] (c) Selection method: the selection method of the genetic algorithm is a process in which the individuals to 
survive in the next generation are selected from within the population. In the present invention, as shown in the flowchart 
on FIG. 10, two parent individuals 1 and 2 are selected randomly from the population, and these are crossed and 
mutated to generate child individuals 1 and 2, and among the four individuals in the group of parent individual 1 , parent 

40 individual 2, child individual 1 and child individual 2, select the two individuals A and B with the highest fitness values 
(Step S25) are selected, and the parent individuals 1 and 2 within the population are replaced with the two selected 
individuals A and B (Step S26). This replacement is a major characteristic in that the individuals in the population do 
not all change at once as what occurs in the typical genetic algorithm. Thereby, it is possible to perform the search 
with a small number of individuals in the population. 

45 [0105] (f) Search end conditions: the search ends when the fitness of the individuals meets the stipulated conditions. 
Here, the condition may be when the maximum fitness within the population exceeds a predetermined threshold value, 
for example. 

[0106] The flowchart in FIG. 11 will be used to describe the process of Embodiment 1 wherein the chromosome 
representation method, individual fitness values, crossover method, mutation method and search end conditions are 

50 determined and the genetic algorithm is used to perform fitting parameter optimization. 

[0107] First, in Step S31 , uniform random numbers are used to create a plurality of individuals as the initial population 
for the genetic algorithm. Thereby, the values of the genes in each chromosome of the initial population can be made 
random real-number values between an upper limit and a lower limit. However, if some type of preliminary knowledge 
is present regarding the trends in the optimal values of the fitting parameters, individuals who would be even more fit 

55 can be created as the initial population. Moreover, for each of the individuals in the initial population, its fitness is 
calculated, and then selection, crossover mutation and replacement are performed sequentially to perform the search. 
[0108] Then in the individual selection step in Step S32, two parent individuals 1 and 2 are randomly selected from 
the population and then the following genetic operation is performed on these individuals. 
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[0109] In the crossover in Step S33, as shown in FIG. 7, the child individuals 1 and 2 are created from the parent 
individuals 1 and 2 picked by selection and the randomly picked parent individual 3. It is noted that this crossover 
occurs on a certain probability (the crossover probability) P c . 

[0110] The mutation in Step S34 performed after the crossover in Step S33 changes the chromosomes by adding 
5 to the genes of the chromosomes of child individuals 1 and 2 a normal random number generated according to a 
Gaussian distribution A/(0 ; o 2 ). It is noted that the probability of this mutation process occurring is P m , called the mutation 
probability. 

[0111] After the mutation process is complete in Step S34, the physics model is actually calculated with the values 
of the chromosomes of the child individuals 1 and 2 thus obtained (fitting parameter values), and the fitness values of 

10 the child individuals 1 and 2 are calculated (Steps S35-S38). When the fitness values of the child individuals 1 and 2 
are thus calculated, next in Step S39, the individual replacement process is performed according to the procedure 
shown in FIG, 10. To wit, among the four individuals in the group of parent individual 1, parent individual 2, child 
individual 1 and child individual 2, the two individuals A and B with the highest fitness values are selected and the 
parent individuals 1 and 2 within the population are replaced with the two individuals A and B. 

15 [01 12] The aforementioned selection, crossover, mutation, evaluation and replacement operations are repeated until 
the search end condition is found to be met in the decision of Step S40, and then the optimization process is terminated 
and the individual with the highest fitness within the individual population at that point in time is used for the fitting 
parameters obtained from the genetic algorithm. It is noted that if the end condition is not met, the search is returned 
to Step S23 to continue the search. 

20 [0113] Moreover, if no chromosome (fitting parameter value) that satisfies the search end condition is found after a 
fixed number of repetitions is performed, in Step S41 the current population is judged to have suffered premature 
convergence, so the process of generating the initial population is performed again. Naturally, there is no need to 
recreate the entire population, but rather it is sufficient to randomly generate 50% of the individuals therein and replace 
them, or it is also possible to issue a warning that the experimental results are not contained within a range that can 

25 be described by the physics model and halt processing. 

[01 1 4] It is noted that there are cases in which the searching speed of the genetic algorithm drops in the final stage 
of searching. This is because it is a global searching technique, so at the rate of reaching a certain local peak, it is not 
comparable to the steepest descent method or other local search techniques that use gradients. Thus, in order to 
shorten the searching time even further, after optimizing the parameters with the genetic algorithm, it is possible to 

30 combine the processing of Step S3 of FIG. 2 with a local search method (a modification of Embodiment 1 ). The method 
used as the local search technique may be the known steepest descent method, Newton method, quasi-Newton method 
or the like. 

[0115] As described above, with the fitting parameter optimization method according to this Embodiment, the pa- 
rameters of the physics model are represented directly as the chromosomes of a genetic algorithm, and the optimal 

35 fitting parameters are found so as to minimize the fitting error according to the genetic algorithm. Accordingly, there is 
no need for trial-and-error to select the initial parameters manually, and moreover, it is possible to determine the optimal 
fitting parameters of the physics model efficiently within a short computation time without being trapped in local peaks. 
Thereby, it is possible to increase the precision of prediction of the physical phenomena under study. 
[0116] It is noted that in the aforementioned Embodiment 1, a genetic algorithm is used as the search technique. 

40 However, in the event that the number of local minima is small in the fitness of the genetic algorithm, it is possible to 
replace the genetic algorithm with an algorithm called the simulated annealing method. In addition, even in cases in 
which the number of local minima is large, while the performance obtained as a result of optimization is lower in com- 
parison to that of the genetic algorithm, the searching can be done faster. 

[01 17] For details of the annealing method, see Simulated Annealing and Boltzmann Machines by E. Aarts and J. 

^5 Korst, published in 1989 by John Wiley & Sons. The annealing method is one type of hillclimbing method, where a 
control parameter called temperature is used to prevent the search from being trapped in local minima. 
[01 1 8] Here follows a description of a modification of this Embodiment made with reference to FIGs. 1 2 and 1 3. The 
physics model fitting parameter optimization problem may have a large number of local minima, so there are cases in 
which premature convergence occurs frequently and a sufficiently precise solution is not obtained. To solve this prob- 

50 (era the inventors proposed limiting the range of individuals within the population that are changed by the genetic 
algorithm (range in which the parents are selected in crossover) in order to give diversity to the genotypes within the 
population. Specifically, in Step S31 of FIG. 11, all of the individuals in the population are disposed upon the vertices 
of a multi-dimensional lattice, and regional subpopulations are formed from each individual and a fixed number of 
neighboring individuals. It is noted that the number of dimensions of lattice vertices and the number of neighboring 

55 individuals can be selected irregardless of the number of parameters, but as a result of numerical experiments, the 
ideal number of dimensions was found to be 2 or 3 and the ideal number of neighboring individuals was 4 to 8. FIG. 
10 shows the case of a two-dimensional lattice where the number of neighboring individuals is 8. It is noted that in an 
n-dimensional lattice, the edges form a torus in order to achieve symmetry. 
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[0119] The genetic operation is performed locally in each of these regional sub-populations. To wit, in Step S32 of 
FIG. 11, the selection process in the flowchart shown in FIG. 13 is performed. First, in Step S50, one vertex is randomly 
selected from among all of the lattice vertices and in the next Step S51 , a regional subpopulation centered upon the 
lattice vertex is formed from Step S50 and the neighboring individuals. Then in Step S52, parent individuals 1 and 2 

5 are randomly selected from within the subpopulation. 

[0120] With the process as described above, even in the case in which the fitness of a certain individual in the 
population is extremely high in the midst of the search, the number of cases in which that individual is selected as the 
parent in crossover is limited, and even if child individuals that resemble that individual arise from crossover, the child 
individuals are disposed within the subpopulation, so the effects of that individual are only gradually extended to the 

10 entire population through the overlapping of subpopulations. For this reason, the problem of premature convergence 
in which the entire population is rapidly unified to a single genotype does not easily arise, thereby maintaining the 
diversity of genotypes. 

[0121] In addition, a parallel computer can be used as a fitting parameter optimization apparatus by allocating one 
processor to a single individual. In this case, the number of dimensions of the lattice and the number of neighboring 

15 individuals are determined depending on the processor topology of the parallel computer. 

[0122] A practical application of the present invention is a materials design system that utilizes molecular dynamics. 
Molecular dynamics is a method by which the movements of the atoms that make up a substance are classically 
analyzed moment by moment, and with this simulation, it is possible to study the dynamic properties and structural 
stability of the material, and the dynamic behavior of the substance under certain conditions on the molecular and 

20 atomic level. An important point in performing molecular dynamics is that the interatomic potentials that greatly affect 

physical properties must not be determined in advance. 

[01 23] To wit, an approximate function type that describes the interatomic potential is postulated in advance and the 
potential parameters contained within that function are determined by fitting with appropriate experimental data. Po- 
tential functions become complex particularly in complex atomic arrangements, amorphous structures and states that 

25 are greatly distorted from a stable structure, so because the unknown parameters to be determined increase, there 
are many cases in which convergence does not occur with the typical least squares method. To solve this problem, 
the optimization method of the present invention may be used to perform the optimized fitting of parameters and in- 
crease the precision of a materials design system and improve the efficiency of work. For example, considered is the 
case of applying the present invention to the potential function of carbon atoms that reproduce an amorphous structure. 

30 The physics model function to be postulated is represented by equation (2). 

+ . v (2) 



where, 



40 



45 



50 



55 



11 



ISDOCID: <EP 141 3981 A1_l_> 



EP 1 413 981 A1 



10 



15 



45 



50 



55 



0< V = 1 + cf/d?-cUd? + (h, - cos* ijk ) 2 ] 
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[0124] In equation (2), r^ is the length of the ij bond, N is the number of atoms, f R , a n and x\ ri are functions related to 
repulsive forces, f A , and Q are functions related to attractive forces and b tj includes the effects of many-body effects. 

20 In addition, f c (i) is the cutoff function for interactions, 6^ is the bond angle between the ij bond and the ik bond, R and 
S are cutoff-related parameters, while A, B, X, u., y, p, n, c, d, h and % are other parameters, x is 1 in the case of atoms 
of the same type, and in order to simplify the potential function, oc,= 0 and \i~yare assumed, so there are nine unknown 
parameters. These unknown parameters are fit to match the experimental results as closely as possible, and just how 
precisely the potential function is set is important for the materials design system. 

25 [0125] For the experimental data, known methods of experimental physics are used to find a plurality of sets of r ijt 
6^ and the potential functions. These nine parameters are expressed as the chromosomes of a genetic algorithm and 
optimized so as to minimize the mean square error between the experimental data and the predicted results. As a 
result, it is possible to determine the potential functions for diamond crystals and amorphous structures with better 
precision than with conventional techniques. 

30 [0126] Next, FIG. 16 and FIG. 17 will be used to describe the experimental results of determining the fitting of pa- 
rameters of a physics model by using the optimal fitting parameter determination method in the modification of Em- 
bodiment 1 of the present invention with respect to the results of measuring the B + concentration distribution (ion 
implantation distribution, ions/cnr 3 ) when B + ions were implanted into a single-crystal silicon substrate. 
[0127] The measurement data for the B + concentration distribution was obtained when the dose (injected amount) 

35 was 1 e+15 (ions/cnr 2 ) (here "1 e+15" represents 10 +15 ) and the concentration distribution was from ten sets of meas- 
urements at acceleration energies between 1 00 keV and 1 MeV in 1 00 keV increments. A physics model was proposed 
by fitting the Pearson IV distribution function in equation (3) to this measurement data. 

( *- a) ' (S) , (3) 
ds b 0 +b A s+b 2 s z 

where, 



s=x-R p 



b^a 

b 2 = -(2p--iy 2 -6)IA 



where, 
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w [01 28] In the fitting optimization calculations with respect to experimental examples, the values of the fitting param- 
eters R pi o p , y and (3 are lined up as the chromosomes of the genetic algorithm (number of parameters n = 4). The 
initial values of the fitting parameters are set in the ranges R p \ 0.0 to 2.0, a p : 0.0 to 0.25. y. -1 .0 to 1 .0 and p: 0.0 to 
50.0. The evaluation function used for the genetic algorithm is the mean square error between the measured data 
values and the fitted Pearson IV distribution function values. It is noted that at the time of calculating the error, the 

15 common logarithm of the concentration value is used instead of the concentration value. In addition, in the range of 
±20% from the center value of the distribution, the error is weighted by 10 times in the evaluation The limit conditions 
are b 1 2 -4b 0 b 2 <0, b 2 < 0 as in equation (3), and if these conditions are not met, the evaluation function value is taken 
to be oo. 

[0129] Taking the number of dimensions in the individual population of the genetic algorithm to be 2 and the number 
20 of neighboring individuals to be 8, the number of individuals in the population was set to 25 (5x5). The search was 
ended at the point when the evaluation function was evaluated 2500 times (the search end condition), and the fittest 
individual obtained in the final generation was subjected to optimization using the quasi-Newton method to obtain the 
ultimate solution. 

[01 30] FIG. 1 6 and FIG. 1 7 show the experimental results from the fitting optimization computation, in this experiment. 

25 in the graph, the horizontal axis is the depth (u.m) from the surface of the substrate while the vertical axis is the con- 
centration (logarithmic scale, units are ions/cm* 3 ), and the broken line shows the measured data for the concentration. 
The solid line is the physics model-fitting curve found from the optimization calculations in the modification of this 
Embodiment. FIG. 1 6 shows the case in which the experimental conditions included B + acceleration energy of 1 0 keV, 
while FIG. 17 shows the case in which the experimental conditions included the acceleration energy of 1 MeV. From 

30 FIG. 16 and FIG. 17, one can see that the physics model-fitting curve fits smoothly to the experimental data, demon- 
strating the effectiveness of the optimization fitting determination method according to the present invention. 
[0131] Here follows a description of Embodiment 2 of the present invention. The sum of the mean square error 
between the experimental data and the predicted data calculated from the physics model is typically used as the 
evaluation criterion for fitting. However, even if an extreme error is present at one point, for example, if the error is 

35 evaluated to be small in the evaluation of the sum of the means square error, evaluation in terms of this sum of mean 
squares alone is insufficient for high-precision fitting, so evaluation of the maximum value of the absolute value of the 
error is also required. 

[0132] When one attempts to perform optimization to a plurality of evaluation criteria simultaneously in this manner, 
with the conventional genetic algorithm, the weighted sum of a plurality of evaluation criteria is taken and made a single 
40 target function, and then this target function is optimized as the fitness. The solution thus obtained is greatly dependent 
on the weighting coefficients. However, the determination of whether predetermined weighting coefficients are valid or 
not can only be confirmed after various optimal solutions are obtained while changing the weighting coefficients of 
each of the plurality of evaluation criteria. Accordingly, it is necessary to perform trial-and-error to obtain satisfactory 
fitting parameters. 

45 [0133] Thus, to solve this problem, the inventors invented a technique of using a genetic algorithm to directly find a 
solution (Pareto-optimal solution) to fit each of the evaluation criteria without using a plurality of weighted evaluation 
criteria. Here follows a description of the processing of Embodiment 2 of the present invention made with reference to 
the flowchart of FIG. 14. 

[0134] FIG. 14 is a flowchart of the fitting parameter multi-objective optimization process, namely the process of 
so optimization using a plurality of evaluation criteria. In the processing of Step S60 and Steps S61 through S63, there 
are differences from Step S31 and Step S32 respectively in the flowchart of FIG. 11 . First, in Step S60 random numbers 
are used to generate the initial individuals of the genetic algorithm and these are placed at all of the lattice vertices as 
shown in FIG. 12. Next in Step S61 , there are temporarily formed regional subpopulations consisting of the individual 
present at each randomly selected lattice vertex and the neighboring individuals centered upon it. 
55 [0135] . Next in Step S62, among the subpopulations thus formed, the individuals that are "inferior" to the center 
individual are examined and child individuals are generated by the number examined. However, even in the case that 
all of the neighboring individuals are superior to the center individual, one new child individual is created. It is noted 
that the expression "inferior" means that a certain individual is inferior to another individual in all of the evaluation 
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criteria. Similarly, the expression "superior" means that it is superior in all of the evaluation criteria. 
[0136] Next in Steps S63 and S64, child individuals of the number determined in Step S62 are generated through 
the crossover illustrated in FIG. 8, and mutations are also induced at that time. One of the parents in the crossover of 
Step S64 is the individual present at the center and the remaining parent is randomly selected from among the indi- 

5 viduals present in the neighborhood. When a child individual is generated through crossover, the physics model is 
computed and the evaluated values of the plurality of criteria for that child individual are calculated. 
[0137] In Step S65, the fitness of the child individual is calculated by calculating the evaluation criteria, e.g. the mean 
square error. Next in Step S66, it is determined whether or not to perform the replacement process depending on the 
superiority relationship between the generated child individual and one individual (called individual E) selected ran- 

10 domly from within the subpopulation. Here follows a description of the replacement process made with respect to the 
flowchart of FIG. 15. In Step S71 of FIG. 15, if the child individual is superior to individual E, individual E is replaced 
with the child individual (Step S72). Conversely, if individual E is superior to the child individual, the replacement is not 
performed. 

[0138] If neither is the case, it is determined whether or not to perform the replacement by means of the technique 
15 called sharing. Sharing replacement is specifically performed in Step S74 based on the calculated value of the number 
of niches of individual E and the child individual within the subpopulation. The number of niches n G is calculated by 
equation (4): 



20 
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n Q = ^Sid{G,H)) (4) 



where, 



\-dla (6<d£c) 
0 (d>a) 



[0139] In equation (4), P represents the entire subpopulation while d(G, H) represents the Euclidean distance be- 
tween individuals G and H in the parameter space. In addition, o is a given constant whereby individuals that are 
separated by more than this value are taken to be individuals that do not resemble each other at all. The value n G 
calculated by equation (4) is an index that indicates roughly how many individuals that are similar to a certain individual 
35 are present in the subpopulation. 

[0140] Thus in Step S75, the number of niches of the child individual and individual E are compared, and if the 
number of niches of individual E is greater than the number of niches of the child individual, individual E is replaced 
with the child individual. 

[0141] This process completes the replacement process of Step S66, so Steps S63 through S66 are repeated the 

40 same number of times as the number of child individuals determined in Step S62. Moreover, the optimization process 
ends when the search end condition is satisfied in the decision of Step S67. Then in Step S4, the user selects the most 
suitable fitting parameter from among the Pareto-optimal solutions obtained as a result of the search, and this is made 
a parameter of the physics model. It is noted that if the end condition is not met in Step S67, the search is returned to 
Step S61 to continue the search. 

45 [0142] Moreover, if no chromosome (fitting parameter value) that satisfies the search end condition is found after a 
fixed number of repetitions is performed, in Step S68 the current population is judged to have suffered premature 
convergence, so the process of generating the initial population is performed again. Naturally, there is no need to 
recreate the entire population, but rather it is sufficient to randomly generate 50% of the individuals therein and replace 
them, or it is also possible to issue a warning that the experimental results are not contained within a range that can 

50 be described by the physics model and halt processing. 

[01 43] In the aforementioned Embodiment 2 of the present invention, a plurality of fitting evaluation criteria are used 
and these are not unified by means of weighting coefficients but rather a genetic algorithm is used to directly search 
for a plurality of Pareto-optimal solutions. Accordingly, there is no need for manual trial-and-error to select weighting 
coefficients, but rather it is possible to discover fitting parameters for the physics model that are optimal for several 

55 evaluation criteria simultaneously. 

[0144] Here follows a description of Embodiment 3 of the present invention. In Embodiment 1 and Embodiment 2 of 
the present invention, the fitting parameters are determined for a single set of measurement data to be fitted (results 
under a single experimental condition). However, in the actual measurements, a certain experimental condition is often 
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varied over a number of stages, and sets of measurement data are acquired at each stage. In this case, there is a 
plurality of sets of experimental data. In the B + implantation experiment (FIG. 16, FIG. 17), the acceleration energy 
that is one experimental condition is varied over ten stages, so ten sets of measurement data are acquired. 
[0145] If there is a plurality of sets of measurement data in this manner, the fitting parameters are often determined 

5 independently for each set of measurement data. (Embodiments 1 and 2 fall into this category.) In this case, if the 
relationship between the fitting parameters thus determined and the varying experimental condition is plotted, there 
are cases in which it does not vary smoothly. FIGs. 18 to 21 are graphs of the fitting parameters as functions of the 
acceleration energy value (experimental condition). From FIGs. 1 8 to 21 , one can see that while the fitting parameters 
R p and <j p vary somewhat smoothly with respect to the acceleration-energy £, fitting parameters y and p do not vary 

10 smoothly. 

[0146] In the event that the fitting parameters do not vary smoothly as in FIGs. 20 and 21, problems occur when 
finding a physics model. At the time of the calculation of the physics model, .under experimental conditions at which 
experiments had not been performed, it is necessary to find the parameters by interpolating between the fitting param- 
eters already obtained experimentally. For example, among the aforementioned experiments, no experiment was per- 

15 formed in the case of acceleration energy of 1 50 keV. 

[0147] In this case, the fitting parameters would be approximated by taking the average of the fitting parameters 
obtained from the measurement data in the cases of acceleration energies of 1 00 keV and 200 keV at which experiments 
had already been performed. For this reason, if the determined fitting parameters do not vary smoothly, the interpolated 
parameters will vary sharply, so a valid simulation based on the physics model cannot be done. 

20 [0148] To solve this problem, Embodiment 3 of the present invention is a method of collectively determining the 
optimal fitting parameters by fitting parameters so that the fitting parameters vary smoothly in between the experimental 
conditions obtained based on measurement data. 

[01 49] FIG. 22 is a flowchart of the process of determining the optimal fitting parameters of a physics mode! according 
to Embodiment 3 ot the present invention. Embodiment 3 differs from Embodiments 1 and 2 on the point that Step S80 
25 and Steps S82 and S83 are performed. Steps S82A and S82B are equivalent to Steps S35 to S38 of FIG. 1 1 . First, in 
Step S80, plural sets of discrete measurements of physical quantities are prepared by varying the experimental con- 
dition in a stepwise manner as in Embodiment 1 . 

[0150] In the next Step S81 , a physics model to be fit to the measurement data is proposed, and in the next Step 
S82, the technique of the genetic algorithm to be described later is used to optimize the parameters of the physics 

30 model proposed in Step S82A to the sets of measurements for each experimental condition. Moreover in Step S82B, 
a collective fitting of the changes in the fitting parameters between the experimental conditions is performed so that 
they are smooth, and finally in Step S83, the parameters of the final physics model are determined. 
[0151] Here follows a description of the technique of the genetic algorithm used in this Embodiment 3. In this genetic 
algorithm, in order to avert an increase in the computation time in Step S82 that occurs because a plurality of parameters 

35 are determined simultaneously, a known local search technique is also used in Step S82. In Step S82, there is no need 
to also use this local search technique if there is no increase in the computation time. 

[0152] In addition, in order to quantitatively evaluate the smoothness of the fitting parameters in between the exper- 
imental conditions, in Step S82B, a further fitting of the fitting parameters in between the experimental conditions is 
performed using a smooth function (fitting function) and the results of it are used in the calculation of the evaluation 
40 function (fitness) in the genetic algorithm. 

[0153] Here follows a detailed description of Embodiment 3 of the present invention. 

(a) Method of representing chromosomes: in this Embodiment, the chromosome representation in the genetic 
algorithm is such that the parameters of the physics model in the respective experimental conditions are lined up 
in a sequence. The structure of chromosomes in the genetic algorithm is such that there is a one-to-one corre- 
spondence between the genes and the physics model's parameter values (a y -, Py, y y -, Qj, fy) for the experimental 
condition j (j= i , m) 

In the example of FIG. 23, when the physics model's parameter values are (+2.31 , -6.45, -3.28, +3.55, -4.12), 
the genetic algorithm's chromosome corresponding to experimental condition 1 becomes (+2.31, -6.45, -3.28, 
+3.55, -4.12). In the example of FIG. 23, the number of parameters : namely the number of genes is 5xm and this 
number is different depending on the physics model proposed. When applied to the B+ implantation experiment, 
the number of parameters becomes 4x10 = 40. 

(c) Selection method: the method shown in Embodiment 1 for the selection method is used. 

(d) Crossover method: the method shown in Embodiment 1 for the crossover method is used. 

(e) Mutation method: a method is used as the mutation method, wherein the value of the gene is randomly initialized 
on a probability of P m for all genes. 

(f) Search end conditions: the search ends when the fitness of the individuals meets the stipulated conditions. 
Here, the condition may be when the maximum fitness within the population exceeds a predetermined threshold 
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value : for example. 

(b) Individual evaluation function: the individual evaluation function of the genetic algorithm, namely the fitness 
used, is the mean square error (Ex. 1 of FIG. 6) calculated for each experimental condition and added over all 
experimental conditions. However, before calculating the mean square error, for each of the experimental condi- 
5 tions, optimization of the fitting parameters is performed using the local search technique for shortening the com- 

putation time. As the initial value of the local search technique (search start point), a value stipulated in the chro- 
mosome is used. 

[0154] The quasi-Newton method may be used as the local search technique. Other known techniques maybe used, 
10 such as the steepest descent method or Powell method. By means of this operation, known techniques are used for 
localized optimization and the initial values of the known techniques are optimized globally with the genetic algorithm, 
so each technique is applied to the portion in which it excels, thus suppressing the increase in computation time ac- 
companying an increasing number of parameters. 

[0155] Local optimization means precisely finding the values of local minima. Global optimization means, when a 
15 plurality of local minima are present within the search space, performing a search among as many partial spaces as 
possible so as not to be trapped in a single local minimum. In this sense, in the cases of Embodiment 1 and Embodiment 
2, the genetic algorithm is applied to both local optimization and global optimization. With the genetic algorithm ac- 
cording to the present invention, global optimization is performed in the crossover of individuals within the population 
and in the initial stages of searching, while local optimization is performed in the final stages of searching. 
20 [01 56] However, in the crossover and mutation steps, the operations perform searches randomly without using gra- 
dient information, so if the number of parameters to be optimized increases, then the computing time required to perform 
local optimization to high precision becomes large. To solve this problem, in Embodiment 3, a known local search 
technique is used for local optimization to shorten the. computing time. 

[0157] With the evaluation function described in (b) in Embodiment 3 above, it is still not possible to quantitatively 
25 evaluate (detect) the smoothness of the fitting parameters among the experimental conditions. FIG. 24 is a flowchart 
of the process of evaluating individuals with the genetic algorithm, specifically a flowchart of the processing of Steps 
S82A and S82B of FIG. 22, where the fitness of individuals is calculated in consideration of the aforementioned smooth- 
ness. These steps are performed between the mutation process and the replacement process. First in Step S90 (S90-1 
through S90-m), as described above, the quasi-Newton method is used to optimize n fitting parameters each inde- 
30 pendently under m experimental conditions. In the next step S91, the fitting parameter thus found is independently 
fitted for each parameter with a smooth function (fitting function) that takes the varied value of the experimental condition 
as an argument. 

[0158] In the B + implantation experiment (FIG.. 16, FIG. 17), the experimental condition varied is the value of the 
acceleration energy E. As the smooth function, the function in equation (5) below can be used. The method of fitting 
35 this smooth function used may be the method of Embodiment 1 or Embodiment 2, or it may be the quasi-Newton 
method that can shorten the computing time. 

[0159] In the case of the B + implantation experiment, taking the acceleration energy E as the argument, the 10 
(number of experimental conditions) x 4 (number of parameters) = 40 fitting parameter values are fitted to 10 data 
items independently for each parameter (R p , <j pt 7, P). As a result of this fitting, four sets of the fitting parameters q h r f 
40 and s, of equation (5) below are found for each parameter. 

G,(E)= q t E'+ Si (5) 

45 [0160] Next in Step, S92 (S92-1 through S92-m), the smooth function (fitting function) found in Step S91 is used to 
calculate the fitting parameters of the physics model under each experimental condition and that value is used to 
recalculate the mean square error with respect to the measured data. 

[0161] FIG. 25 is a detailed flowchart. First in Step S100 (S100-1 through S100-n), the fitting function found in Step 
S91 is used to calculate the value of the fitting parameter of the physics model under experimental condition /for each 
parameter. In the case of the B + implantation experiment, under experimental condition 1 for example, the acceleration 
energy is 100 keV, so E = 100 is substituted into equation (5) and the values of q h r,and s,- found in Step S91 are used 
to calculate the parameters R p , o p , y and 3, respectively. 

[0162] Next in Step S101, the fitting parameters calculated in Step S100 (S100-1 through S100-n) are used to es- 
tablish the physics model under experimental condition 7, and that physics model is used to simulate the experiment 
under experimental condition /. For example, in the case of experimental condition 1 in the B + implantation experiment, 
the B + ion concentration distribution is simulated in the case that the acceleration energy is 1 00 keV. 
[0163] In the final Step S102, the error between the results of the simulated experiment in Step S101 and the actual 
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measurements under experimental condition j is calculated, and the final mean square error under experimental con- 
dition j is calculated. For example, in the case of experimental condition 1 in the B + implantation experiment, the mean 
square error between the measured values indicated by broken lines in FIG. 16 and the results of the simulation is 
calculated. 

5 [0164] In Step S92, the aforementioned steps S1 00 through S1 02 are executed for each experimental condition to 
calculate the mean square error under each experimental condition. Lastly in Step S93, the mean square errors under 
each experimental condition calculated in Step S92 (S92-1 through S92-m) are summed up to give the collective fitness 
of individuals in the genetic algorithm. It is noted that when adding the mean square errors, it is possible to give weighting 
to certain experimental conditions if those experimental conditions are to be emphasized. 

10 [0165] With the aforementioned parameter fitting optimization method, as illustrated in the examples of FIG. 20 and 
FIG. 21 , if non-smooth data is fit with a smooth function, the fitting parameters determined by the recalculation of Step 
S101 will be greatly shifted from the values found independently under the various experimental conditions in Step 
S90, so the final mean square error in Step S92 increases. Thereby, the smoothness of the fitting parameters among 
the experimental conditions can be detected quantitatively. 

15 [0166] In this manner, the method of representing chromosomes, individual fitness values, crossover method, mu- 
tation method, selection method and search end conditions are determined, and the genetic algorithm is used to perform 
collective optimization of fitting parameters. The process flow in the Step S82 portion of FIG. 22 may be made nearly 
the same process as in Embodiment 1 of FIG. 11. Here follows a description of the portions that are different from 
Embodiment 1 of FIG. 11. 

20 [0167] First, the processes of Steps S35-S38 of FIG. 11 may use the evaluation processes of FIG. 24, respectively. 
In addition, the mutation process of Step S34 may use the method described in (e) above. Afterthe optimization process 
in Step S40 is complete, in Step S83 of FIG. 22, the group of fitting parameters found in Step S1 00 (Steps S-1 through 
S1 00-n) of the individual with the highest fitness within the individual population at that point in time is set as the fitting 
parameters obtained by the genetic algorithm. In addition, the fitting parameters of the physics model for the experi- 

25 mental conditions that had not been measured can also be calculated simply using the smooth function found in Step 
S91. 

[0168] Here follows the calculated results of applying the optimal fitting parameter determination method using the 
genetic algorithm according to this embodiment to the data in the B + implementation experimental results. 
[0169] The proposed physics model, boundary conditions and experimental conditions are the same as in Embodi- 
30 ment 1. FIGs. 26 to 29 show the fitting parameters obtained as a result of the experiment. In comparison with the 
experimental results of FIGs. 1 8 to 21 , one can see that the parameters are smoothly fitting-optimized with respect to 
the acceleration energy. The results of optimal fitting of the physics model to measured data show a good fitting nearly 
identical to FIG. 1 6 and FIG. 1 7. This experiment confirmed the effectiveness of the optimization method of Embodiment 
3. 

35 [0170] As described above, with the fitting parameter optimization method according to this embodiment, even in 
the case in which a plurality of experimental conditions are present, it is possible to find collectively optimal fitting 
parameters of physics models in consideration of the smoothness of fitting parameters between experimental condi- 
tions. Accordingly, there is no need for manual trial-and-error to obtain smooth fitting parameters, and it is possible to 
efficiently optimize the fitting parameters of physics models during short computing times. Thereby, an optimized phys- 
40 ics model can be used in Technology CAD (TCAD) or other design tools. 

[0171] The present invention provides an optimal fitting parameter determination apparatus that works the methods 
of Embodiments 1 -3. 

[0172] FIG. 30 is a functional block diagram of the optimal fitting parameter determination apparatus that works the 
methods of Embodiment 1 and Embodiment 2. The fitting parameter optimization apparatus 1 0 has a fitness calculating 

45 means 11 that calculates the fitness of an individual, a genetic operation processing means 12 that selects an individual 
from among an individual population and performs crossover, mutation, replacement and other genetic operations, an 
evaluation means 13 that evaluates whether or not the individual population has met the search end condition, a 
memory 14 and an input/output means 15. The fitness calculating means 11 , genetic operation processing means 12 
and evaluation means 13 may each consist of an independent CPU or one CPU maybe used in a time-sharing manner. 

so [0173] A CPU starts up a stipulated program stored in a stipulated region of the memory 14 and executes various 
processing steps according to that program. The memory 14 stores individual information (chromosomes, fitness) for 
the genetic algorithm. A physics model calculation device 1 6 has a memory 1 6M and a CPU, and calculates the physics 
model according to a stipulated program stored in a stipulated region of the memory 16M, and outputs the results. 
[0174] The physics model calculation device 16 may also be included within the fitting parameter optimization ap- 

55 paratus 1 0. In this case, as shown in FIG. 31 , the fitting parameter optimization apparatus 1 0 would include the fitness 
calculating means 11, genetic operation processing means 12, evaluation means 13, memory 14 and a physics model 
calculation means 17, and the fitness calculating means 11 , genetic operation processing means 12 and evaluation 
means 13 share the memory 14 and physics model calculation means 17. 
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[0175] In the optimization process, first a keyboard or the like within the input/output means 15 is used to select a 
physics model used to predict experimental data and that information is given to the physics model calculation device 
16. In addition, the number of individuals in the population, crossover probability, mutation probability and other con- 
stants in the genetic algorithm are also given from the input/output means 15 to the fining parameter optimization 
5 apparatus 10 and stored in a stipulated region of the memory 14. Thereafter, the CPU begins processing according to 
a stipulated program stored in a stipulated region of the memory 14. 

[0176] In the fitness calculating means 1 1 , after giving experimental data, a signal to start the physics model calcu- 
lation is given to the physics model calculation device 16. When the physics model calculation device 16 finishes 
calculating the physics model, the calculation result (simulation result) data is passed to the fitting parameter optimi- 
se zation apparatus 10. Using this data, the fitness calculating means 1 1 calculates the fitness that is stored in the memory 
14. The genetic operation processing means 12 uses the fitness determined by the fitness calculating means 11 to 
perform various genetic operations and stores the results in the memory 14. The evaluation means 13 calculates the 
end condition for the genetic algorithm and if it is met, the final optimal fitting parameters are determined and stored 
in the memory 14 and also output on a printer or CRT within the input/output means 15. 
15 [01 77] FIG. 32 is a functional, block diagram of the optimal fitting parameter determination apparatus that works the 
optimal fitting parameter determination method of Embodiment 3. As in FIG. 30, the fitting parameter optimization 
apparatus 10 has a fitness calculating means 11 , genetic operation processing means 12, evaluation means 13, mem- 
ory 14, input/output means 15 and also has a local search technique processing means 18 and parameter fitting 
processing means 19. The fitness calculating means 11, genetic operation processing means 12, evaluation means 
20 13, local search technique processing means 18 and parameter fitting processing means 19 may each consist of an 
independent CPU or one CPU may be used in a time-sharing manner. As in FIG. 31 , the physics model calculation 
device 16 may also be included in the fitting parameter optimization apparatus 10 as shown in FIG. 33. 
[0178] In the optimization process, first a keyboard or the like within the input/output means 15 is used to select a 
physics model used to predict experimental data and that information is given to the physics model calculation device 
25 16. In addition, the number of individuals in the population, crossover probability, mutation probability and other con- 
stants in the genetic algorithm are also given from the input/output means 15 to the fitting, parameter optimization 
apparatus 10 and stored in a stipulated region of the memory 14. Thereafter, the CPU begins processing according to 
a stipulated program stored in a stipulated region of the memory 14. 

[01 79] In the fitness calculating means 1 1 , after giving experimental data under various conditions, a signal to start . 

30 the local optimization calculation is given to the local search technique processing means 18. The local search tech- 
nique processing means 18 repeatedly exchanges data with the physics model calculation device 16 and performs 
local optimization calculations. When the local search technique processing means 18 finishes the local 1 optimization 
calculation, the calculation result data is stored in the memory 14. The local search technique processing means 18 
performs the local optimization calculation the same number of times as the number of experimental conditions and 

35 all of the calculation results are passed to the fitness calculating means 11 via the memory 4. 

[0180] Next, the fitness calculating means 11 sends a signal to the parameter-fitting processing means 19 to begin 
the fitting calculations based on a smooth function. The parameter fitting processing means 19 calculates and finds a 
fitting function for the fitting parameters in the local optimization calculation results stored in the memory 4. These 
calculation results are stored in the memory 14 and passed to the fitness calculating means 11 . 

40 [0181] The fitness calculating means 11 sends these fitting parameters to the physics model calculation device 1 6 
and starts calculation in the physics model calculation device 16. The results of calculation from the physics model 
calculation device 1 6 are passed to the fitting parameter optimization apparatus 1 0 and stored in the memory 1 4. Using 
this data, the fitness calculating means 1 1 calculates the fitness that is stored in the memory 1 4. The genetic operation 
processing means 12 uses the fitness determined by the fitness calculating means 11 to perform various genetic 

45 operations and stores the results in the memory 14. The evaluation means 13 calculates the end condition for the 
genetic algorithm and if it is met, the final optimal fitting parameters are determined and stored in the memory 14 and 
also output on a printer or CRT within the input/output means 15. 

[0182] Moreover, the present invention provides an optimal fitting parameter determination program executed by a 
computer that implements the procedures of the optimal fitting parameter determination method presented in FIG. 2, 

so FIG. 3, FIG. 7, FIGs. 10-15, FIG. 22, FIG. 24 and FIG. 25. The optimal fitting parameter determination program ac- 
cording to the present invention may be installed from recording medium or the Internet via the input/output device of 
a computer consisting of the various means shown in FIGs. 30 to 33, for example, and stored in a single memory or 
plurality of memories. Thus, this computer becomes an optimal fitting parameter determination apparatus serving as 
the apparatus for working the method according to the present invention. 

55 [0183] It goes without saying that the present invention is applicable to all of the parameters of a physics model 
containing a plurality of parameters, or some of the parameters, or the parameters of models formed by combining a 
plurality of models, so this application is not excluded from the scope of the present invention regardless of the scale 
of the physics model. 
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[01 84] The present invention was described in the above with reference to the illustrated examples, but the invention 
is in no way limited to the aforementioned examples, but rather it includes other constitutions and modifications that a 
person skilled in the art may easily arrive at within the scope of the invention recited in the appended claims. 

5 Industrial Applicability: 

[0185] As described above, the following meritorious effects can be obtained with the present invention. 
[0186] By representing the fitting parameters of a physics model with real-number vectors, preparing a population 
of a plurality of individuals having the chromosomes and using a genetic algorithm to optimize the fitting parameters, 
10 there is no need to discretize chromosome information, and the precision of the solution obtained and the computation 
time are not affected by the precision of discretization. 

[0187] Moreover, by the genetic algorithm comprising at least: a selection step of selecting at least two parent indi- 
viduals, a child individual generation step of generating a plurality of new child individuals by applying at least one of 
a group of genetic operations consisting of a crossover process and a mutation process to the selected parent individ- 
15 uals, and a replacement step of determining the individuals to be made individuals of the next generation of the pop- 
ulation from among the selected parent individuals and the generated plurality of child individuals, extremely efficient 
searches can be performed without becoming trapped in local minima. 

[0188] In the child individual generation step of the genetic algorithm, by the crossover process generating child 
individuals with real-number vectors having as components values appearing according to a continuous stipulated 
20 incidence probability distribution, and the incidence probability distribution being set based on the real-number vector 
components of each of the selected parent individuals, global searches can be performed in the initial stages of search- 
es in which the distances among the parents within the population are large, while local searches can be performed 
in the final stages of searches in which the distances among parents are short. 

[0189] In the child individual generation step of the genetic algorithm, by the mutation process that generates child 
25 individuals with real-number vectors having as components values appearing according to a continuous stipulated 
incidence probability distribution, and by the incidence probability distribution that is such thatthe incidence probability 
becomes higher the closer to at least one of the selected parent individuals, efficient local searches can be performed 
in the mutation process. In the selection step of the genetic algorithm,, by three parent individuals being selected and 
the incidence probability distribution being a normal distribution centered on the center points of two of the three selected 
30 parent individuals, and the standard deviation of the normal distribution being such that the component in the direction 
of the main axis connecting the real-number vectors of the two parent individuals is proportional to the distance between 
the two parent individuals, and the components in other axes being proportional to the distance between the main axis 
and the remaining one of the three selected parent individuals, while maintaining the distribution of the individual 
population, global searches can be performed in the initial stages of searches in which the distances among the parents 
35 within the population are large, while local searches can be performed in the final stages of searches in which the 
distances among parents are short. 

[0190] By laying out the population of a plurality of individuals on lattice vertices, and in the selection step, regional 
subpopulations are formed from each individual and a stipulated number of neighboring individuals, and at least two 
parent individuals are selected from among the regional subpopulations, it is possible to eliminate premature conver- 
ge gence wherein the entire population is rapidly unified to a single genotype. 

[0191] In the replacement step of the genetic algorithm, by selecting from among the selected parent individual and 
the generated plurality of child individuals, the individuals in which one evaluation criterion is superior as the individuals 
of the next generation of population, it is possible to shorten the computing time by reducing a plurality of evaluation 
criteria to a single evaluation criterion. 
45 [0192] In the replacement step of the genetic algorithm, by selecting from among the selected parent individual and 
the generated plurality of child individuals, the individuals of the next generation of population determined based on a 
superiority relationship consisting of two or more evaluation criteria, it is possible to find collectively judged optimal 
fitting parameters based on a plurality of optimal solutions fit to each of the evaluation criteria. 
[0193] By performing optimization by means of a local search technique with respect to the fitting parameters opti- 
50 mized using the genetic algorithm, it is possible to prevent deterioration of the searching speed in the final stages of 
the search and further increase the precision of fitting parameters. 

[0194] By finding optimal fitting parameters for the physics models for each set of experimental conditions for meas- 
urement data, and also finding physics models wherein the fitting parameters are fitted using fitting functions so that 
the changes among experimental conditions are smooth, and collectively determining the optimal fitting parameters 
55 of the physics models for each experimental condition, it is possible to simulate physical phenomena with physics 
models without error even under experimental conditions at which experiments were not performed. 
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Claims 

1 . A method of determining optimal fitting parameters, comprising: in a physics model having a plurality of parameters, 
in order to determine optimal fitting parameters for discrete data points obtained by measurement of physical 

5 quantities, representing said plurality of parameters in a form of real-number vectors as information on chromo- 

somes of a genetic algorithm, preparing a population of a plurality of individuals having said chromosomes and 
using the genetic algorithm to optimize fitting parameters. 

2. The method of determining optimal fitting parameters according to claim 1 , wherein said genetic algorithm com- 
10 prises at least: a selection step of selecting at least two parent individuals, a child individual generation step of 

generating a plurality of new child individuals by applying at least one of a group of genetic operations consisting 
of a crossover process and a mutation process to the selected parent individuals, and a replacement step of 
determining individuals to be made individuals of a next generation of population from among the selected parent 
individuals and the generated new child individuals. 
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The method of determining optimal fitting parameters according to claim 2, wherein, in said child individual gen- 
eration step, said crossover process generates child individuals with real-number vectors having as components 
values appearing according to a continuous stipulated incidence probability distribution, and said incidence prob- 
ability distribution is set based on the real-number vector components of each of the selected patent individuals. 



4. The method of determining optimal fitting parameters according to claim 2, wherein, in said child individual gen- 
eration step, said mutation process generates child individuals with real-number vectors having as components 
values appearing according to a continuous stipulated incidence probability distribution, and said incidence prob- 
ability distribution is such that an incidence probability becomes higher the closer to at least one of the selected 

25 parent individuals. 

5. The method of determining optimal fitting parameters according to claim 3, wherein, in said selection step, three 
parent individuals are selected and said incidence probability distribution is a normal distribution centered on center 
points of two of the three selected parent individuals, and a standard deviation of the normal distribution is such 

30 that a component in a direction of a main axis connecting real-number vectors of said two parent individuals is 

proportional to a distance between said two parent individuals, and components in other axes are proportional to 
a distance between the main axis and a remaining one of the three selected parent individuals. 

6. The method of determining optimal fitting parameters according to any one of claims 2 to 5 S wherein said population 
35 of the plurality of individuals is laid out on lattice vertices, and in said selection step, regional subpopulations are 

formed from each individual and a stipulated number of neighboring individuals, and the at least two parent indi- 
viduals are selected from among the regional subpoputations. 

7. The method of determining optimal fitting parameters according to any one of claims 2 to 6, wherein, in said 
^o replacement step, from among the selected parent individuals and the generated new child individuals, individuals 

of the next generation of population are determined based on a superiority relationship consisting of one evaluation 
criterion. 

8. The method of determining optimal fitting parameters according to any one of claims 2 to 6, characterized in that, 
45 in said replacement step, from among the selected parent individuals and the generated new child individuals, 

individuals of the next generation of population are determined based on a superiority relationship consisting of 
two or more evaluation criteria. 

9. The method of determining optimal fitting parameters according to any one of claims 1 to 8, wherein optimization 
50 by means of a local search technique is performed with respect to the fitting parameters optimized using said 

genetic algorithm. 

10. The method of determining optimal fitting parameters according to any one of claims 1 to 9, wherein said physics 
model is provided for each of different experimental conditions, a plurality of sets of measurement data are provided 

55 by varying each of the experimental conditions in a stepwise manner, optimal fitting parameters for the physics 

model are found for each set of measurement data by means of an optimization technique, said fitting parameters 
are fitted using fitting functions so that changes among the experimental conditions are smooth, and the optimal 
fitting parameters of the physics model for each experimental condition are determined collectively. 
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11. The method of determining optima! fitting parameters according claim 10, wherein said optimization technique is 
performed by means of a local search technique. 

12. An optimal fitting parameter determination apparatus for a physics model having a plurality of parameters, com- 
5 prising: fitness calculation means that, for discrete data points obtained by measurement of physical quantities, 

calculates a fitness based on measurement data and predicted values calculated from the physics model, genetic 
operation means wherein the plurality of parameters are represented in a form of real-number vectors as informa- 
tion on chromosomes of a genetic algorithm and genetic operations of the genetic algorithm are performed on a 
population of a plurality of individuals having said chromosomes, and judgment means that judges whether or not 
10 a next generation of the individual population meets an evaluation criterion, wherein an individual that has a highest 

fitness within the individual population when the next generation of the individual population meets the evaluation 
criterion is used for the optimal fitting parameters of said physical model. 

13. The optimal fitting parameter determination apparatus according to claim 12, wherein said genetic operation means 
15 comprises at least: a selection processor that selects at least two parent individuals, a child individual generator 

that generates a plurality of new child individuals by applying at least one of a group of genetic operations consisting 
of a crossover process and a mutation process to the selected parent individuals, and a replacement processor 
that determines. individuals to be made individuals of the next generation of the individual population from among 
the selected parent individuals and the generated new child individuals. 
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14. The optimal fitting parameter determination apparatus according to claim 13, wherein, in said child individual gen- 
erator, said crossover process generates child individuals with real-number vectors having as components values 
appearing according to a continuous stipulated incidence probability distribution, and said incidence probability 
distribution is set based on real-number vector components of each of the selected parent individuals. 



15. The optimal fitting parameter determination apparatus according to claim 13, wherein, in said child individual gen- 
erator, said mutation process generates child individuals with real-number vectors having as components values 
appearing according to a continuous stipulated incidence probability distribution, and said incidence probability 
distribution is such that an incidence probability becomes higher the closer to at least one of the selected parent 

30 individuals. 

16. The optimal fitting parameter determination apparatus according to claim 14, wherein, in said selection processor, 
three parent individuals are selected and said incidence probability distribution is a normal distribution centered 
on center points of two of the three selected parent individuals, and a standard deviation of the normal distribution 

35 is such that a component in a direction of a main axis connecting real-number vectors of said two parent individuals 

is proportional to a distance between said two parent individuals, and components in other axes are proportional 
to a distance between the main axis and a remaining one of the three selected parent individuals. 

17. The optimal fitting parameter determination apparatus according to any one of claims 1 3 to 16, wherein said pop- 
40 ulation of the plurality of individuals is laid out on lattice vertices, and in said selection processor, regional subpop- 

ulations are formed from each individual and a stipulated number of neighboring individuals, and at least two parent 
individuals are selected from among the regional subpopulations. 

18. The optimal fitting parameter determination apparatus according to any one of claims 13 to 17, wherein, in said 
45 replacement processor, from among the selected parent individual and the generated new child individuals, indi- 
viduals of the next generation of population are determined based on a superiority relationship consisting of one 
evaluation criterion. 

19. The optimal fitting parameter determination apparatus according to any one of claims 13 to 17, wherein, in said 
so replacement processor, from among the selected parent individual and the generated new child individuals, indi- 
viduals of the next generation of population are determined based on a superiority relationship consisting of two 
or more evaluation criteria. 

20. The optimal fitting parameter determination apparatus according to any one of claims 12 to 19, further comprising 
55 processing means that performs optimization by means of a local search technique with respect to the fitting 

parameters optimized using said genetic algorithm. 

21. The optimal fitting parameter determination apparatus according to any one of claims 13 to 19, further comprising: 
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optimization means that, when a plurality of sets of measurement data are provided by varying each of experimental 
conditions in a stepwise manner finds optimal fitting parameters for each set of measurement data by means of 
an optimization technique, and parameter fitting processing means that fits said fitting parameters using fitting 
functions so that changes among the experimental conditions are smooth, wherein said fitness calculation means 
calculates the fitness based on the fitting parameters found by said parameter fitting processing means. 

22. The optimal fitting parameter determination apparatus according to claim 21, wherein said optimization means 
performs optimization by means of a local search technique. 

23. An optimal fitting parameter determination program executed by a computer, that implements a process wherein: 
parameters of a physics model having a plurality of parameters arc represented in a form of real-number vectors 
as information on chromosomes of a genetic algorithm, and a population of a plurality of individuals having said 
chromosomes is prepared and the genetic algorithm is used to optimize fitting parameters. 

24. The optimal fitting parameter determination program according to claim 23, wherein said genetic algorithm com- 
prises at least: a selection step of selecting at least two parent individuals, a child individual generation step of 
generating a plurality of new child individuals by applying at least one of a group of genetic operations consisting 
of a crossover process and a mutation process to the selected parent individuals, a fitness calculation step of 
calculating the physics model and calculating fitness values of the generated new child individuals, and a replace- 
ment step of determining individuals to be made individuals of a next generation of population from among the 
selected parent individuals and the generated new child individuals based on the calculated fitness values. 

25. The optimal fitting parameter determination program according to claim 24, wherein, in said child individual gen- 
eration step, said crossover process generates child individuals with real-number vectors having as components 
values appearing according to a continuous stipulated incidence probability distribution, and said incidence prob- 
ability distribution is set based on real-number vector components of each of the selected parent individuals. 



26. The optimal fitting parameter determination program according to claim 24, wherein, in said child individual gen- 
eration step, said mutation process generates child individuals with real-number vectors having as components 
values appearing according to a continuous stipulated incidence probability distribution, and said incidence prob- 
ability distribution is such that an incidence probability becomes higher the closer to at least one of the selected 
parent individuals. 



27. The optimal fitting parameter determination program according to claim 25, wherein, in said selection step, three 
35 parent individuals are selected and said incidence probability distribution is a normal distribution centered on center 

points of two of the three selected, and a standard deviation of the normal distribution is such that a component 
in a direction of a main axis connecting real-number vectors of said two parent individuals is proportional to a 
distance between said two parent individuals, and components in other axes are proportional to a distance between 
the main axis and a remaining one of the three selected parent individuals. 

40 

28. The optimal fitting parameter determination program according to any one of claims 24 to 27, wherein said popu- 
lation of the plurality of individuals is laid out on lattice vertices, and in said selection step, regional subpopulations 
are formed from each individual and a stipulated number of neighboring individuals, and at least two parent indi- 
viduals are selected from among the regional subpopulations. 

45 

29. The optimal fitting parameter determination program according to any one of claims 24 to 28, wherein, in said 
replacement step, from among the selected parent individual and the generated new child individuals, individuals 
of the next generation of population are determined based on a superiority relationship consisting of one evaluation 
criterion. 

50 

30. The optimal fitting parameter determination program according to any one of claims 24 to 28, wherein, in said 
replacement step, from among the selected parent individual and the generated new child individuals, individuals 
of the next generation of population are determined based on a superiority relationship consisting of two or more 
evaluation criteria. 

55 

31 . The optimal fitting parameter determination program according to any one of claims 23 to 30, wherein optimization 
by means of a local search technique is performed with respect to the fitting parameters optimized using said 
genetic algorithm. 
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32. The optimal fitting parameter determination program according to any one of claims 23 to 30, wherein optimal 
fitting parameters for the physics model are found for each set of measurement data by means of an optimization 
technique, said fitting parameters are fitted using fitting functions so that changes among experimental conditions 
are smooth, and the optimal fitting parameters of the physics model for each experimental condition are determined 

5 collectively. 

33. The optimal fitting parameter determination program according to claim 32, wherein said optimization technique 
is performed by means of a local search technique. 

10 
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FIG. 12 
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FIG. 16 



Fitting results in a Pearson distribution-type physics model 
(B + implantation into single-crystal silicon substrate at 100 keV 
acceleration) 

1 e+20 t — , . . — , — : , 




1e+15 ' ' « > : 1 

0 0. 2 0. 4 0. 6 0. 8 1 



Depth from the substrate surface (//m) 



38 

1*1398tA1_l_> 



EP1 413 981 A1 



F I G. 1 7 



Fitting results in a Pearson distribution-type physics model 
(B + implantation into single-crystal silicon substrate at 1000 keV 
acceleration). 



le+20 




Depth from the substrate surface (fim) 



SOOCID: <EP H13981A1J_> 



39 



EP 1 413 981 A1 



FIG. 18 



Fitting parameter R p as a function of acceleration energy 
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FIG. 20 



Fitting parameter y as a function of acceleration energy 
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FIG. 25 
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FIG. 26 



Fitting parameter R p as a function of acceleration energy 
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FIG. 28 
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FIG. 2 9 



Fitting parameter ^ as a function of acceleration energy 
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FIG. 30 
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